Skip to content

Conversation

@aneesabeck
Copy link

Author: Aneesa Beckford

Summary:
This pull request introduces the complete first version of the Brain-Score interactive layer visualization tool, developed as part of my UROP project.
The goal of this tool is to provide an interactive visualization of brain-model layer architectures and their relationships, enabling researchers to quickly inspect layer metadata, structure, and connectivity. It is designed to support scalable and interactive integration into model card visualizations for the Brain-Score platform.

Features Implemented:

  • Interactive Layer Rendering
    • Renders each layer as a 3D block using SVG <rect> and <polygon> elements (front, top, side).
    • Text labels identify each layer visually.
  • Layer Colors
    • Yellow: Layer is associated to a brain region
    • Green: No associated region annotation
  • Zoom & Pan Support
    • Implements D3’s zoom() behavior to allow smooth scaling and translation across complex architectures.
    • Limits scale extent to keep interaction manageable.
  • Metadata Inspection
    • Clicking on a layer displays a floating tooltip with detailed metadata.
    • Shift-click allows multi-layer selection, populating a side panel with combined metadata.
  • Connection Arrows
    • Directed connections between layers are rendered as straight or curved Bezier paths.
    • Includes self-loop arrows for recurrent connections.
    • Arrowheads are styled using SVG definitions and scale properly with zoom.
  • Dynamic Layout Logic
    • Layer positions are dynamically computed based on dimensions provided in JSON input.
  • Robust User Experience
    • Clicking outside a layer clears selections and tooltips.
    • Visual highlighting makes selected layers easily identifiable.

Final Visualization Demo:

final-brainscore-visualization.mov

Future Enhancements:

  • Extend visualization to support real neural networks beyond the current dummy architecture.
  • Replace hardcoded or placeholder layer data with dynamic loading from actual model metadata.

@aneesabeck aneesabeck requested a review from KartikP May 19, 2025 22:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants